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REMARKS 

Applicant files herewith an amended set of claims, which have been amended to 
overcome the Examiner's objections. 



Claims 10, 12 and 14 have been amended to recite "A data classification 
apparatus,.. Claims 10, 14, 15 and 18 have been amended to p$||e that no. new matter 
is added. In these claims, the phrase "an overall stt ^S^es^Sue 5, has been replaced by 
the phrase "a single strangeness value", in accordance ymi paf^^, line 10. Claims 15 
and 17 now recite "a computer-implemented data classinfeation nrap«d w to ensure that 



they relate to statutory subj ect matter, ! ^ 



& 1 



The claims have also been amended to ensure; that they are fully distinguished 
from the prior art, as explained below.; In particular, claims 10, 14, 15 and 18 now 
include the formula by which the single str&geness value 'isj determined by the assay 
means. This formula is not shown or suggdstedjri ahyVof the prior art documents- 



The inven1a^^|^tes toj||n apparatus fbr..and a method of data classification of 
unknown items, using a^tl^n^ examples. 




■ ■ the aim of the ihvention^j^ only to predict a classification for an unknown 
item, but also to provide a\mfeasur6 of confidence in that classification, valid under the iid 
assumption. 1 This is the assumption that the training and unknown examples are 
generated from the same, distribution, 

As defined in amended claim 10, the data classification apparatus comprises an 
input device for receiving training classified examples and at least one unclassified 
example, a memory for storing the examples, an output terminal for outputting a 
predicted classification for the unclassified example and a processor for identifying the 
predicted classification, where the processor includes classification allocation means for 
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allocating potential classifications to each unclassified example and for generating a 
plurality of classification sets, each set containing the plurality of training classified 
examples (/) with the classification and at least one unclassified example (7+1) with its 
allocated potential classification, an assay means including an example valuation device 
which determines individual strangeness values (a,) for each training classified example 
(z-l 5 2.../) and at least one unclassified example (f=/+1) having an allocated potential 
classification (y), the assay means determining a single strangeness value (d(y)) valid 
under the iid assumption for each classification set in dependence on the individual 
strangeness values (ai) of each example by a given, Joirnula, a comparative device for 



selecting the classification set to which the mo^ikely 4 potential classification for the 
unclassified example belongs on the basis ofyl^ingle stfongeness value assigtied by the 
assay means, and a strength of prediction monitorinl§to^ fcfr determining a confidence 



value for the predicted classification on the basis of the*||hjrie strangeness value assigned 
to the classification set to which the ^6cipii^;;qiost likely p^bej^^al classification of the 
unclassified example belongs. <r 



The fonnxil^W((k) = — , where 6=1,2..../, calculates the 




single strangeness value b^fc of the individual strangeness values of 

the training examples ( ^ ( ( greaf|ffl^an^or equal to the individual strangeness value of the 
unclaissified example, an^diyidin^fe by the total number of examples. 

Thus, the Apparatus/starts with training classified examples, and uses these to 
predict the classification of an unclassified example. The classification allocation mean 
allocates potential classifications to each unclassified example, and generates a number of 
classification sets, each containing the said training examples with their classification, 
and at least one unclassified example with a potential classification, Each pair of the 
example and classification in the set is tested by the assay means to determine its 
individual strangeness value. That is a measure of how strange it would be if the 
classification were correct. The assay means then determines a single strangeness value, 
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valid under the iid assumption, for each classification set, in dependence on the individual 
strangeness values. The comparative device compares the single strangeness value for all 
the sets, to see which is most likely to be correct for the unclassified example. The 
strength of prediction monitoring device then looks at the second most likely 
classification, on the basis of the single strangeness values, to give a measure of 
confidence that the most likely classification is in fact correct. Thus, the greater the 
difference between the single strangeness values of the most likely potential classification 
and the second most likely potential classification, the!' greater is the measure of 
confidence that the most likely classification is correct. 

®K - v. ■ 



We submit that this combination of f£|^£ 5 and ^particular the formula, is not 
shown in any of the prior art documents. 



Applicant agrees that Mizuno; shows, an input d^Gg^a memory, an output 
terminal and a processor, with the processor including, classifj^ation allocation means and 
assay means. Howeve|jg^^|cant submits, that Mizuno, calculates an error between a 
classification assignef/to an i^j^pwn pattern and a correct classification, and initiates re- 




training when the av^ge errm/exceeds a predetermined value, This copes with the 



possibility t]^^^ by a different mechanism from the 

traininfi^tterns (sefeM^mn r^TO&s 9 to 19). This differs from the invention as claimed, 
whi<iffll|cdfies that the^^le strSimess value is valid under the iid assumption, in that 
the unknowjB^d traininft;t|xamples are generated from the same distribution. It is 
submitted that^aftoin 7, Mes 1 to 12 of Mizuno do not show the determination of an 
individual sti^gene^Sjjpilue for each training example and an unknown example and then 
the determination of^a single strangeness value for each classification set, in dependence 
on the individual strangeness values. In particular, Mizuno does not show the formula 
now included in amended claim 10. Applicant agrees that Mizuno does not teach a 
Strength of prediction monitoring device for determining a confidence value for the most 
likely classification, on the basis of the single strangeness value of the second most likely 
potential classification. 
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It is submitted therefore that claim 10 is clearly novel over Mizuno. Further, 
Mizuno does not show or suggest determining a single strangeness value valid under the 
iid assumption, and indeed is concerned with the possibility that the unknown patterns are 
generated from a different distribution, rather than the same distribution. Thus, Mizuno 
teaches away from the invention, rather than towards it. In addition, Mizuno does not 
show or suggest determining individual strangeness values and then a single strangeness 
value, either in general or on the basis of the claimed foraiulay nor the strength of 
prediction monitoring device for a confidence value on the hasis pf the single strangeness 
value of the second most likely potential classification. 

Tsuboka relates to pattern recognition,employing the Hidden Mark0v Model, and 
is particularly relevant to speech recognition or cithejrtime series. In such pattern 
recognition it is necessary to identify spoken word, and to decide which of a number of 
classified words it is most likely to be|tetaiijles of classified words are put into clusters 



and then the probability is calculated \fliat m^fer;4 belongs to a particular cluster, 
Tsuboka recognises that a ; pattern to be rec^^d has apPrent probabilities of belonging 
to different clusters,, and calculates the prob%lity in various ways, using a comparative 
device to select the most likely classification, %j$vever, the aim of Tsuboka is simply to 
find the cluj^i^^^ie highest pfbbabilify ?t for accuracy of recognition. 

^•™*-Jicant submit^l^at firstly "Tsuboka does not use the iid assumption, as claimed 
by the apph^tt, Secondl^fApplicant submits that Tsuboka does not use the second most 
likely classifical^as a st?Sfngth of prediction monitoring device. The passage indicated 
by the Examiner (cdfil^ 1 1 lines 1 1 to 20) appears simply to say that a pattern could be 
in more than one classification with different probabilities. The subsequent portion of the 
specification indicates how the most likely classification is then computed. Tsuboka 
clearly does not show the use of the formula, as now included in amended claim 10. 



Thus, it is submitted that claim 10 is clearly novel over Tsuboka. Further, 
Tsuboka does not show or suggest using the second most likely allocated potential 
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classification as a strength of prediction monitoring device for determining a confidence 
value of the predicted classification. Claim 10 is therefore clearly inventive in view of 
Mizuno, 

With regards to a combination of Mizuno and Tsuboka, it is submitted that they 
would not lead to the present invention. Firstly, neither is concerned with ensuring that 
the strangeness value is valid under the iid assumption, and ind^t^4izuno is concerned 
with the possibility that the unknown patterns are generate^&i a different distribution. 
In addition, neither Mizuno nor Tsuboka shows the^e on^*second most likely 
classification as the strength of prediction monitoring device to p&icje a confidence 
value for the coirectness of the predicted classification. ^ M^f? 

Thus, a combination of M^uno and Tsubbka, . even though they are both 
concerned with maintaining accuracy Ll S^ifefilassification 5 simply would not lead to the 
present invention, as claimed in claim lOl^ec^K^^e lack (tf provision of a confidence 
value using the second most likely classifi%tipi, and^^Kt that the strangeness values 
are not valid under the iid assumption. The <$|mbination also fails to show the use of the 
formula enumerated ift flie. claim'; • , |^ 

flicart claim 10 is clearly distinguished from all the prior 

art, i&nd^|r|herefore allotj^le. Claims 14, 15 and 18 have the same limitations as claim 
10, and it iff^rorefore subniied that these are also allowable, 

%, J 

As claims V^ft^'l 7 are dependent on claims 10 and 15, it is submitted that these 

}/' 

are allowable to the Same extent 
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Conclusion 

The application is considered in good and proper form for allowance, and the 
Examiner is respectfully requested to pass this application to issue. If, in the opinion of the 
Examiner, a telephone conference would expedite the prosecution of the subject application, 
the Examiner is invited to call the undersigned attorney. 



Date: November 5, 2004 



Amendment or ROA - FinaJ (Revised 10/21/2004) 



TSft 



Respectfully submi' 




Dennis R. Schlemraer, Reg. 1^24,703 
LEYDIG, VOIT & MAYER, ffi^^.,> 
Two' Prudential Plaza, Suite 490C 
1 80 Ndrth'Stetson Avenue 
Chicago, Illinois 60601-6780 

^ (312)6l6-5600;(telephone) 

lW/312) 616-5700 ^fecsimile) 
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